Michelson, Jennifer 


From: 63077-40655591@requests.muckroek.com 

Sent Monday, January 14, 2019 2109 AM 

To: Michelson, Jennifer 

Subject RE: California Public Records Act Request: Pred doI documents, Livermore 


Livermore Police Department 
PRA Office 
1110 S Livermore Ave 
Livermore, CO 94550 

January 14,2019 

This is a follow up to a previous request: 

To Whom It May Concern: 

I'm following up on the following California Public Records Act request, copied below, and originally 
submitted on Oct. 30,2018. You had previously indicated that it would be completed on Jan. 14,2019.1 wanted 
to check on the status of my request, and to see if there was a new estimated completion date. 

Thanks for your help, and let me know if further clarification is needed. 

Filed via MuckRock.com 

E-mail (Preferred): 63077-40655591@requests.muckrock.com 

Upload documents directly: https://www.muckrock.com/accoxmts/agency login/livermore-police-department- 

12041/predpol-documents-livermore-63077/?uuid-login=316c8db5-c82a-4959-b3aa- 

978f60099ed9&email=JMichelson%40cityoflivermore.net#agency-reply 

Is this email coming to the wrong contact? Something else wrong? Use th ; above link to let us know. 

For mailed responses, please address (see note): 

MuckRock News 
DEPT MR 63077 
411A Highland Ave 
Somerville, MA 02144-2516 

PLEASE NOTE: This request is not filed by a MuckRock staff member, but is being sent through MuckRock 
by the above in order to better track, share, and manage public records rec uests. Also note that improperly 
addressed (i.e., with the requester's name rather than "MuckRock News" tnd the department number) requests 
might be returned as imdeliverable. 


On Dec. 20,2018: 
Good Afternoon, 


"* I write in response to your Public Records request dated October 30th 201 {1. Any documents responsive to your 
request will be made available by January 14th 2019. 

Jennifer Michelson 
Records Supervisor 
Livermore Police Department 
(925) 371-4939 
(925) 371-4950 Fax 


On Nov. 16,2018: 

Thank you for letting me know, I look forward to hearing back. 
Best, 

Caroline Haskins 


On Nov. 9,2018: 

Good Afternoon, 

I write in response to your public records request dated October 30th 2018. After review of the requested 
documents, it has been determined that in accordance with California Government Code Section 6253(c) the 
Livermore Police Department is exercising their right to extend the requinjd response time by an additional 14 
days in order to collaborate with other divisions within the department to jjrovide the information that has been 
requested. 

Thank You, 

Jennifer Michelson 
Records Supervisor 
Livermore Police Department 
(925) 371-4939 
(925) 371-4950 Fax 


On Oct. 30,2018: 

To Whom It May Concern: 

Pursuant to the California Public Records Act, I hereby request the following records: 

Recent media reports suggest that the Livermore Police Department has made use of or will make use of 
Predpol predictive policing software, (https://boingboing.net/2018/10/30/jl-monte-and-tacoma.html) 

Therefore, I am requesting the following records related to the above promam: 

* Any software and algorithms developed for the implementation of the program. Pm particularly interested in 
any algorithms that have a public policy outcome, such as providing guidance on a policy or an assessment of 
an individual. More generally, I would like any software that was develoj>ed by or with, given to, used by, 
purchased or licensed to this agency for implementation of the above referenced program. This would include 
original source code, any compiled binaries (also known as executables), spreadsheets, program scripts, and 
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'■ otlier'digital materials used to calculate any data in the above program. It would also include the input training 
data for machine learning algorithms. Collectively, these responsive mater ais ■will be referred to as "the 
software" in the following paragraphs. 

* All instructional materials, presentations and presentation materials (including recorded video and audio, 
PowerPoint files, prepared remarks, and slides formats), and other guidance on the use of "the software." This 
includes any notes taking during meetings that discussed the use of the software, any explanations (whether 
internally or externally generated) of how the software works, and any oth ^r document that has been used to 
help explain the use of "the software" to any party, including internal documentation, public relations materials, 
and executive summaries. This also includes any description of input and output data fields that will aid in 
understanding the type of information that is submitted to the software, and that is produced by the software. 

* A copy of any privacy impact assessments, use policies, standard operating procedures, data retention 
policies, legal opinions, warranties, non-disclosure agreements, contracts, iiability waivers, insurance 
agreements. Requests for Proposals, Responses to Requests for Proposal, Memorandums of Understanding, 
Letters of Interest, usage policies, or informal agreements that reference "the software" or otherwise guide it use 
or the relationship between this agency and the provider or developer of the software. 

* A copy of any funding opportimity announcements, grant applications ajid grantor status/progress reports, 
reports to legislative bodies, annual reports that mention the use of the So^are, as well as audit records, 
including but not limited to security audits of the software, misuse reports, and reports to oversight bodies. 

* A copy of any validation studies conducted with respect to the program or ivith respect to any software or 
algorithms used in connection with the program, and a copy of any record 5 pertaining to inquiries for the need 
of validation studies, or discussion of potential or actual validation studies. By “validation study,” I mean any 
study designed to assess how accurate the program is in predicting what it is supposed to predict, or to assess 
whether the program may err in the direction of either under- or overestim ating likelihoods or predicted 
outcomes, or may produce any results that are biased or unexpected in any way. 

* For the aspects of the software that require an input, for example, to compute a value, we request a copy of the 
five most recent sets of data that were used for input, as well as the five most recent outputs of the software, in 
whatever their native format is. If these inputs or ou^uts include exempt information, we ask that you exempt 
only that information which is specifically exempted from law, and provide the other material. 

The requested documents will be made available to the general public, and this request is not being made for 
commercial purposes. It will be used in the course of reporting for Moth©'board, VICE’s science and 
technology website (www.motherboard.vice.com). 

The requested documents will be made available to the general public, an 1 this request is not being made for 
commerci^ purposes. 

In the event that there are fees, I would be grateful if you would inform me of the total charges in advance of 
fulfilling my request. I would prefer the request filled electronically, by ejmail attachment if available or CD- 
ROM if not. 

Thank you in advance for your anticipated cooperation in this matter. I lo )k forward to receiving yom response 
to this request within 10 calendar days, as the statute requires. 

Sincerely, 

Caroline Haskins 
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Filed via MuckRock.com j 

E-mail (Preferred): 63077-40655591@requests.muckrock.com j 

Upload documents directly: https://www.muckrock.com/accounts/agency_ilogin/livermore-police-department- 
12041/predpol-documents-livermore-63077/?uuid-login=316c8db5-c82a-4959-b3aa- 
978f60099ed9&email=JMichelson%40cityoflivermore.net#agency-reply ; 

Is this email coming to the wrong contact? Something else vwong? Use the above link to let us know. 

For mailed responses, please address (see note): 

MuckRock News 
DEPT MR 63077 

411A Highland Ave i 

Somerville, MA 02144-2516 

PLEASE NOTE: This request is not filed by a MuckRock staff member, bjut is being sent through MuckRock 
by the above in order to better track, share, and manage public records requests. Also note that improperly 
addressed (i.e., with the requester’s name rather than "MuckRock News" and the department number) requests 
might be returned as undeliverable. i 
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